Some Notes On Classical and Operant Conditioning

two conditioning paradigms:
Pavlov / Rescorla
classical conditioning (Hilgard and Marquis, 1940)
  • also called respondent conditioning (Skinner, 1938)
  • Thorndike / Skinner
    operant conditioning (Skinner, 1938)
  • also called instrumental conditioning (Hilgard and Marquis, 1940)
  • what kind of regularities are learned?
  • those that the animal can't control
  • relations between stimuli out in the world
  • those that the animal can control
  • relations between animal's behavior and its consequences
  • what are the relevant events and in what sequence must they occur?
  • CS - US/REINFORCEMENT - UR/CR
  • S - REINF - R
  • (discriminative) stimulus - response - REINFORCEMENT
  • S - R - REINF
  • does reinforcement depend on the animal's behavior / response?
    no - presented independent of behavior
    yes - contingent on behavior according to reinforcement schedule
    is the response elicited or emitted?
    elicited - US causes UR; animal is forced to respond
    emitted - reinf. doesn't cause response; animal responds at will
    what is the nature of the response to be made?
  • reflex or other visceral response (i.e., in tissues and organs)
  • usually involuntary
  • action or skeletal response (e.g., movement of limbs)
  • usually voluntary
  • what does the animal "learn"?
    learns a signal, i.e., that US is coming (CS->US)
    learns a behavior, i.e., one that brings about a reinforcement
    what is the principle or mechanism governing the conditioning process?
  • Rescorla (and us): contingency / dependency of US on CS
  • (Pavlov: contiguity / frequency of CS-US pairing)
  • law of effect: utility or consequences of response
  • (contiguity's role: delay of reinforcement weakens response)